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Abstract 

Rationale: Accurate measurement of subsolid pulmonary nodules (SSN) is becoming increasingly important in the 
management of these nodules. SSNs were previously quantified with time-consuming manual measurements. The aim of 
the present study is to test the feasibility of semi-automatic SSNs measurements and to compare the results to the manual 
measurements. 

Methods: In 33 lung cancer screening participants with 33 SSNs, the nodules were previously quantified by two observers 
manually. In the present study two observers quantified these nodules by using semi-automated nodule volumetry 
software. Nodules were quantified for effective diameter, volume and mass. The manual and semi-automatic measurements 
were compared using Bland-Altman plots and paired T tests. Observer agreement was calculated as an intraclass correlation 
coefficient. Data are presented as mean (SD). 

Results: Semi-automated measurements were feasible in all 33 nodules. Nodule diameter, volume and mass were 1 1.2 (3.3) 
mm, 935 (691) ml and 379 (311) milligrams for observer 1 and 11.1 (3.7) mm, 986 (797) ml and 399 (344) milligrams for 
observer 2, respectively. Agreement between observers and within observer 1 for the semi-automatic measurements was 
good with an intraclass correlation coefficient >0.89. For observer 1 and observer 2, measured diameter was 8.8% and 
10.3% larger (p<0.001), measured volume was 24.3% and 26.5% larger (p<0.001) and measured mass was 10.6% and 12.0% 
larger (p<0.001) with the semi-automatic program compared to the manual measurements. 

Conclusion: Semi-automated measurement of the diameter, volume and mass of SSNs is feasible with good observer 
agreement. Semi-automated measurement makes quantification of mass and volume feasible in daily practice. 
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Introduction 

Lung cancer screening with computed tomography (CT) has 
increased the awareness of a specific subtype of pulmonary 
nodules: the subsolid nodule (SSN). A SSN is defined as a 
circumscribed area of increased lung attenuation with preservation 
of the bronchial and vascular margins and also referred to as a 
ground glass opacity. [1] A SSN can be part-solid (part of the 
nodule completely obscures the underlying lung parenchyma) or 
pure nonsolid. Persistent SSNs have a high likelihood of 
malignancy. The ELCAP study [2] reported a malignancy rate 
of 34% for all nonsolid SSNs, 18% for pure ground glass lesions 



and 63% for part-solid SSNs. For part solid lesions even higher 
malignancy rates with numbers up to 75% are reported. [3] 

Recently, a statement from the Fleischner Society with 
recommendations for the management of SSNs detected at CT 
was published. [4] It was recommended that, because most non 
solid SSNs prove either to be benign or pre malignant,a 3 month 
and then annual follow up is appropriate. A monitoring strategy 
can obviate unnecessary surgery and potentially avoid overdiag- 
nosis in cases in which no change is identified. Monitoring should 
also allow early identification of lesions that will prove to be 
adenocarcinomas manifesting as pure nonsolid SSNs. For solitary 
part-solid SSNs, especially those in which the solid component is 
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larger than 5 mm, it was stated that, when persistent, these 
should be considered malignant until proven otherwise. It is 
evident that accurate automated measurements of SSNs can 
be valuable to follow these recommendations and detect 
(absence) of growth as early as possible. For that purpose 
volume measurements are preferable to diameter measure- 
ments. For SSNs there is evidence that mass measurements 
are preferable to volume measurements. [5] However, most 
volumetry software is developed for solid pulmonary nodules 
and fails when segmenting SSNs. SSNs were manually 
segmented previously by two observers which took about 10 
minutes for each nodule, making it inappropriate for daily 
routine. [5] Recently, software has become available for semi- 
automatic segmentation of SSNs in which these nodules are 
segmented within a second. [6,7] 

The aim of this study was to the test the feasibility of nodule 
volumetry software for SSNs and to compare diameter, volume 
and mass measurements on CT exams of subsolid pulmonary 
nodules of the semi-automated software to the results of the 
manual segmentations. 

Methods 

Study Participants 

This is an ancillary study of the Dutch-Belgian Lung Cancer 
Screening Trial (NELSON trial; ISRCTN63545820). The 
NELSON trial was approved by the Dutch and Belgian 
Ministries of Health and by the ethical review board of the 
participating hospitals. Written informed consent was obtained 
from each participant. The trial population comprised current 
or former smokers between 50 and 75 years old at time of 
inclusion with a smoking history of at >15 cigarettes /day 
during >25 years or >10 cigarettes /day during >30 years. 
Former smokers were included only if they quit smoking < 1 0 
years before the start of the study. Exclusion criteria for 
participating in the lung cancer screening trial were self- 
reported moderate or poor health status and/or inability to 
climb two flights of stairs, recent chest CT, current or previous 
history of cancer at time of inclusion, and body weight £ 140 kg. 



Participants were randomized to the screening arm (screening 
with low-dose CT) or the control arm (no imaging). 

For the current analysis, all 2994 baseline CT examinations 
performed at one of the study sites (University Medical Center, 
Utrecht, the Netherlands) were included. All 33 SSNs > 5 mm 
detected in 33 volunteers and recorded in the Nelson Management 
System were used in our current evaluation. 

CT Scanning and reading protocol 

The NELSON protocol included a low-dose CT-examination. 
Patients were imaged using a 1 6-detector-row CT scanner 
(Mx8000 IDT or Brilliance- 16, Philips Medical Systems, Cleve- 
land, OH) in helical mode with 16x0.75-mm collimation and 15- 
mm table feed per rotation (pitch 1.3). CT acquisition was done in 
full inspiration. No intravenous contrast was injected. Exposure 
settings were 30mAs at 120kVp for patients weighing <80 kg, and 
30mAs at 140kVp for those weighing more than 80 kg. Axial 
images of 1.0 mm thickness were reconstructed at 0.7 mm 
increment with a 512x512 matrix, using a moderately soft kernel 
and the smallest field of view (FOV) that included both lungs. The 
CT exams were evaluated by double reading with a consensus 
reading in case of discrepant results. All CT exams were read for 
nodules and detected nodules were characterized as solid nodule 
or subsolid nodule, either nonsolid or part-solid. 

Subsolid nodule evaluation and measurements: detected 
SSNs 

Of the 33 participants with a GGN 25 (76%) were male. The 
age was 61.5 (SD 6.4) years, the number of packyears was 41.1 (SD 
19.0) and 17 (51.5%) were current smokers All included SSNs 
were manually segmented previously by two obser- 
vers. (BdH,SvdV) These results and the agreement between the 
observers have previously been published. [5] 

For the present study a software program was used to semi- 
automatically segment and quantify the nodule. Two observers, 
one with 10 years experience with chest CT (PdJ) and one with 
over 30 years experience (ETS) measured the nodules indepen- 
dently with this software program. One observer (ETS) repeated 



Table 1. Results of manual and semi-automatic measurements of 33 subsolid nodules on CT 







Semi-automatic measurements 


Manual measurement 


Difference 




mean 


SD 


Mean 


SD 


p-value 


Observer 1 first 


Diameter (mm) 


11.2 


3.3 


12.2 


3.7 


<0.001 


Volume (ml) 


935 


692 


1201 


934 


<0.001 


Mass (milligrams) 


379 


311 


431 


369 


0.007 


Observer 1 second 


Diameter (mm) 


10.8 


3.8 


12.2 


3.7 


<0.001 


Volume (ml) 


930 


809 


1201 


934 


0.001 


Mass (milligrams) 


378 


341 


431 


369 


0.02 


Observer 2 


Diameter (mm) 


11.1 


3.7 


12.2 


3.7 


-C0.001 


Volume (ml) 


985 


797 


1201 


934 


0.001 


Mass (milligrams) 


399 


344 


431 


369 


0.07 



Differences are tested with the paired samples T test. 
doi:1 0.1 371 /journal.pone.0080249.t001 
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Figure 1. Bland-Altman plots for two observers of relative differences between manual and semi-automatic measurements of 
subsolid nodules on CT for diameter (top row), volume (middle row) and mass (bottom row). 

doi:10.1371/journal.pone.0080249.g001 



the measurements after > 1 month to assess intraobserver 
agreement. 

The prototype of this software program has been described 
previously [6] and was adapted to handle SSNs. The user can 
either click a center point or draw a stroke on the largest diameter 
of the nodule as an input to the algorithm. Based on this user 
input, a volume of interest (V OI) is automatically defined around 
the nodule. An initial segmentation is acquired by region growing 
using thresholds applicable to subsolid nodules. Default value for 
the lower threshold is —750 HU, and for the higher threshold 
— 150 HU. Two parameters, density threshold value and 
roundness versus irregularity, can be adjusted by the user of the 



program to optimize the segmentation if this is felt to be necessary 
by the observer. 

Finally, a sequence of morphological operations is used to 
remove the chest wall and adjacent vessels, if applicable. 

SSN mass was calculated by expressing attenuation values in 
terms of physical density. CT attenuation in Hounsfield units can 
be translated directly into physical density in milligrams per 
milliliter by adding 1000 to the Hounsfield unit value. For soft- 
tissue nodules, the prerequisites for this approach are that the 
nodule contains no calcium and that no contrast material was 
injected. The mass within the nodule volume, as outlined on all 
sections that contained the nodule, was calculated by multiplying 
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Table 2. Between and within observer agreement for semi- 
automatic subsolid nodule measurements. 



threshold was adjusted in 9 (28%) cases. Manual measurements 
involved about 10 minutes per SSN and semi-automatic 
measurements involved a few seconds. 



Diameter Mass 
(mm) Volume (ml) (milligrams) 



Observer 1, first reading 0.89 
Versus 

Observer 1, second reading 
Observer 1, first reading 0.95 
versus Observer 2, reading 
Observer 1, second reading 0.90 
Versus 
Observer 2 



0.92 



0.97 



0.95 



Data given are intraclass correlation coefficients. 
doi:1 0.1 371 /journal.pone.0080249.t002 



nodule volume by mean nodule density (ie, mean CT number + 
1000) [8]. 

Data analysis 

Data are presented as mean and standard deviation (SD) or 
percentage (%). Diameter, volume and mass of the SSNs were 
compared between the mean of the two results of the manual 
measurement and the various semi-automatic measurements using 
the method described by Bland and Altman [9] and by paired T- 
tests. Observer agreement was calculated as an intraclass 
correlation coefficient. P-values <0.05 were considered significant. 

Results 

Subjects and nodule characteristics 

Thirty-three participants had a total of 33 SSNs at baseline 
according to NMS. The semi-automated program failed in none of 
the nodules. Of these 33 subsolid nodules, 19 were pure ground 
glass and 14 were part-solid. The mean diameter was just above 
one centimetre (Table 1). Observer 1 did not make any adjustment 
to the semi-automated measurements in 22 (67%) of the 
measurements, in 7 (2 1 %) the density cut-off was adjusted and 
in 4 (12%) the roundness was adjusted. Observer 2 did not make 
any adjustment in 24 (73%) of the measurements and the density 




Figure 2. Illustration of manual and semi-automatic nodule 
segmentation on CT. The semi-automatic measurement is presented 
on the left, and the manual measurement on the right. At the right side 
of both images are 3 zoomed images from top to bottom axial, coronal 
and sagital plane. Note the irregularity of the manual measurements in 
the coronal and sagital plane. This is because manual segmentations 
are done in the axial plane, while semi-automatic measurements are 
truly 3D. 

doi:1 0.1 371 /journal.pone.0080249.g002 



Comparison of manual and semi-automatic 
measurements and observer agreement 

Nodule diameter, mass and volume were significantly different 
between the mean values of the two manual measurements and 
semi-automated measurements (all p<0.05), except for the mass 
measurements performed by observer 2 (Table 1). The average 
difference between manual and the three semi-automated 
measurements was in diameter 1.0 to 1.4 mm, in volume 215 to 
271 ml and in mass 32 to 52 mg. On average diameter, volume 
and mass were measured 8.8%- 10.3%, 24.3%-26.5% and 
10.6% — 12.0% smaller with the manual measurements when 
compared to the semi-automated measurements (Figure 1). The 
intraclass correlation between and within observers was good 
(>0.89, Table 2) and the agreement was best for mass 
measurements. 

Discussion 

Our results show that semi-automated measurement of SSNs is 
feasible with good observer agreement. This result is in agreement 
with the previous conclusions of Oda et al [10] who concluded 
that with computer-aided volumetry of subsolid nodules, the 
relative volume measurement error was small for nodules 5 mm in 
diameter or larger. Intraobserver and interobserver agreement was 
relatively good for nodules 8 mm in diameter or larger. 

SSN dimensions measured by semi-automated volumetry 
software compared closely to the results of manual measurements, 
but dimensions were slightly larger. These results are promising as 
the importance of SSN quantification is increasingly recognized 
and manual measurements are impractical due to the time 
involved in the segmentation. 

SSNs are a major challenge, both clinically [1 1] and in a lung 
cancer screening setting [2], because these nodules are relatively 
rare, slow growing, often multiple and bear a high malignancy 
rate. Although transient SSNs can represent a large range of 
benign diseases, persistent SSNs have a high likelihood of 
malignancy, with reported malignancy rates ranging from 18% 
to 75% [2,3]). In the first round of the Dutch-Belgian lung cancer 
screening trial only 2.0% of the detected nodules, of the total of 
8673 nodules found in 7557 participants, were nonsolid nodules or 
part-solid nodules [12]. In the NELSON trial volumetry software 
was used to measure dimensions of solid nodules, because 
volumetry has been proven to be superior to diameter measure- 
ments in terms of accuracy and reproducibility. The SSN were 
assessed visually and by manual diameter measurement as no 
volumetry software was available for SSNs and volumetry software 
for solid nodules often failed when segmenting SSNs. However, for 
SSN accurate measurement is becoming increasingly important, 
too, as differentiation between benign and malignant nodules is 
largely based on change in size or on the development of a solid 
component. Recendy, a statement from the Fleischner Society 
with recommendations for the management of SSNs detected at 
CT was published. [4] For persistent solitary nonsolid nodules it 
was recommended that monitoring is appropriate to enable early 
detection of even subtle interval change in their appearance. Such 
monitoring could prevent overtreatment and allow early identifi- 
cation of growing lesions that prove to be adenocarcinomas. For 
solitary part-solid SSNs, especially those in which the solid 
component is larger than 5 mm, it was stated that these should 
be considered malignant until proven otherwise provided no 
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regression of the nodule is seen at a follow-up CT examination 
performed in 3 months. It is evident that accurate semi-automated 
measurements of SSNs can be valuable to follow these recom- 
mendations and detect growth as early as possible. Furthermore, 
for SSNs there is evidence that mass measurements are preferable 
to volume and diameter measurements. [5] 

In order to be feasible in clinical practice segmentation of SSNs 
must not be time consuming but easy and swift. In a previous 
study, SSNs were manually segmented by two observers and it 
took them about 10 minutes to segment one nodule. Recently, 
software has become available for semi-automated segmentation 
of SSNs in which nodules can be segmented in a few seconds. By 
using the new software semi-automated measurement of SSNs 
were found to be feasible with good observer agreement. Reported 
SSN dimensions compared closely to manual measurements, but 
dimensions with the semi-automated approach were slightly larger 
than the manual measurements. 

The applied semi-automated software has previously been tested 
in an anthropomorphic phantom study. [13] In that study the semi- 
automated measurements compared closely to the true values 
without systematic errors. It may therefore well be that the manual 
measurements systematically underestimate nodule dimensions. 
The semi-automated software can now be further tested to 
investigate the interscan error in the large amount of CT imaging 
data that has been acquired as part of lung cancer screening trials. 

Our study is limited by the lack of a true 'gold' standard as we 
compared our results to those of manual segmentations. The semi- 
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